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(54) TERMINAL DEVICE 

(57)Abstract: 

PROBLEM TO BE SOLVED: To obtain the terminal 
device in which the information based on the position of 
the terminal is superimposed and displayed on the 
present picture being displayed on a screen. 
SOLUTION: A video inputting TV camera 2, a global 
positioning system antenna for position data 
determination 4 and a transmitter-receiver 3 are 
provided to a portable personal computer 1. Moreover, a 
database is provided in the hard disk of the terminal. The 
present position information of the terminal, which is 
obtained through the antenna 4 by a control means, is 
made as a retrieving key and related information is 
obtained from the database and the information is 
superimposed on the picture and displayed. 
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* NOTICES * 

JPO and NCI PI are not responsible for any 
damages caused by the use of this translation. 

1. This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2. **** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



CLAIMS 



[Claim(s)] 

[Claim 1] In a personal computer, the television camera for an image input, and the global 
positioning system antenna for location data acquisition, The database which the transmitter- 
receiver for a communication link was attached and was made to hold in the hard disk in a 
terminal unit further. Display the image inputted from said television camera for an image input 
on the terminal image of the display of said personal computer, and current positional information 
of the terminal unit acquired using said global positioning system antenna is used as a search 
key. The terminal unit characterized by having the control means which acquires related 
information from said database, is made to superimpose on said image, and is displayed. 
[Claim 2] A control means is a terminal unit according to claim 1 characterized by being what 
chooses and displays 1 of the close-range view information which shows the current position, 
the intermediate view information which shows the information on over there for a while, and the 
distant view information which shows the information on distant, or two or more. 
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DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] This invention is a technique in connection with the terminal unit which 
can carry and move, and the so-called mobile terminal unit, and is a technique in connection with 
the method of presentation on this mobile terminal unit. 

[0002] And it is concerned with the personal computer which is not a personal computer like 

office used in the fixed location but a migration place, or is used while moving. 

[0003] 

[Description of the Prior Art] Conventionally, although the terminal unit which can carry out 
pocket maintenance existed, since a terminal unit was not able to acquire automatically when 
recording a location and time amount, human being had to input. 

[0004] Moreover, although the image which this let the network circuit pass and was acquired by 
the transmitting side although there was equipment which connected the communication device 
to the television camera or the still camera could be sent to the other party, attached 
information, such as a camera station at that time, had to be transmitted separately. It was not 
able to record and hold by the transmitting side, either. 

[0005] Furthermore, although there was a video conference system used on a desktop, since it 
was a premise to fix and use the location to be used, like the above-mentioned television camera 
sending set, this was a transmitting side, it does not hold attached information, such as a 
location, and does not have the need, either, and was not able to be transmitted, either. 
[0006] 

[Problem(s) to be Solved by the Invention] As mentioned above, since there was no means to 

acquire the present location data, information based on location data was not able to be 

expressed as the conventional terminal technique on equipment in the end of a local. Moreover, 

since location data were not able to be transmitted to a communication link place, the 

information display based on location data was not made in a receiving side. 

[0007] Since the display based on the location of a terminal unit was not able to be performed, 

even if it faced the superposition display on a screen, there was no approach of displaying the 

information related to the image inputted from current and a television camera. 

[0008] The purpose of this invention is to provide the present image as which a transmitting- 

side terminal unit solves the point that the geographical location of equipment cannot be grasped 

in the end of a local, and is displayed on the screen with the terminal unit which can indicate the 

information based on a location by superposition. 

[0009] 

[Means for Solving the Problem] This invention is characterized [ main ] by what a television 
camera and location data acquisition equipment (global positioning system) are connected to the 
migration terminal unit of a pocket mold, and the information related to this is superimposed on 
the image inputted from the television camera, and is displayed on a screen. 
[0010] The image which acquired and acquired an image and location data to coincidence, and 
the point which displays information based on location data on coincidence on a terminal unit 
differ from a Prior art. 
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[0011] 

[Embodiment of the Invention] 

The [1st operation gestalt] The 1st operation gestalt (it corresponds to claim 1) is hereafter 
explained to a detail using a drawing. 

[0012] The block diagram of the terminal unit applied to this invention at drawing 1 is shown. In 
this drawing, 1 is a pocket mold personal computer and 1A is that display. 2 is a television 
camera for an image input, and 3 is a transmitter-receiver for a communication link. 4 is a global 
positioning system (henceforth GPS) antenna for location data acquisition. In addition, since the 
GPS antenna itself is common knowledge, the explanation is omitted. 

[0013] The processing flow after a data input is shown in drawing 2 . Actuation of the terminal 
unit of this **** drawing 1 for processing flows is explained. The image data 14 inputted from 
the television camera 2 for an image input (only henceforth a television camera) perform display 
22 to display 1 A as it is using the graphic display function of a terminal unit. Or an image 
processing and recognition processing 15 are performed, the description object in an image is 
extracted, and the recognition data 16 are obtained. There is a name of an object etc. in the 
recognition data 16 as an example. Database (DB) retrieval processing 17 is performed using the 
obtained recognition data 16, the retrieval output 18 which are the attached information on an 
object and related information is obtained, and display 22 is performed. 

[0014] the location data 19 obtained based on the signal inputted from the GPS antenna 4 for 
location data acquisition perform DB retrieval processing 20, obtain geographic information 
(name of a location etc.) and the related information 21, such as etc., " — ********(ing) — ", 
and perform the display 22 on a screen for this. Geographic information and related information 
21 can be used as an input of DB retrieval processing 17 for specifying an object with the 
recognition data 16, and can raise the precision of the retrieval output 18 obtained after that. 
[0015] The received data 11 obtained by the transmitter-receiver 3 for a communication link 
perform DB retrieval and transform processing 12 based on the contents, and obtain a retrieval 
output and an indicative data 13. As an example of received data 1 1, there are a class of crater 
for screen display based on Terminal ID and a display position on a screen as the geographic 
information of the terminal unit of a transmitting-side terminal ID number and a transmitting side, 
and an example of the retrieval output and the indicative data 13 which changes this and is 
obtained. A retrieval output and an indicative data 13 perform the display 22 on the terminal unit 
of a receiving side. 

[0016] The image data 14 used as the object which performs display 22, the retrieval output 18, 
and geographic information and related information 21 are set as the object of transmission 23 
as it is. 

[0017] And as a control means which performs the above control, CPU in the pocket mold 
personal computer 1 takes charge, and it displays on the display 1A. 

[0018] The [2nd operation gestalt] Next, the 2nd operation gestalt of this invention is explained. 
[0019] The following explanation is concerned with expansion of the contents of processing in 
the display 22 shown in drawing 2 . 

[0020] Although display 22 is performed by display 1A of the pocket mold personal computer 1, 
this display 1A has composition divided and displayed on the low order plane 31 for the display of 
the image data 14, and the high order plane 32 for the display of other data, as shown in drawing 
3 . In drawing 3 , although the bit plane for a superposition display of other data is shown for the 
bit plane for graphic display in the low order plane 31 as a high order plane 32, even if reverse, it 
is good. 

[0021] The low order plane 31 which is a bit plane for graphic display prepares eight planes (8 
bits, 256 colors) and 24 planes (full color [ 16,400,000 colors ] 24 bits) with the color number, 
when graphic display is monochrome and it is one plane (1 bit, two colors) and a color. 
[0022] Since there may be little expression capacity, the high order plane 32 which is a bit plane 
for a superposition display prepares 1 thru/or 2 planes. Below, since it is easy, explanation is 
advanced, using the high order plane 32 as one sheet using the low order plane 31 as eight 
sheets. In addition, each plane is a theoretical bit plane and superimposes the value of each bit 
plane by Orr. 
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[0023] Signs that the low order plane 31 and the high order plane 32 lap with drawing 4 , and 
display 22 is performed to it are shown. 

[0024] In drawing 4 , it inputs and displays, and inputs into the high order plane 32 which shows 
the information display based on the location input from the GPS antenna 4 to drawing 3 ? and 
indication 22 is given to the low order plane 31 which shows the image from a television camera 
2 to drawing 3 R> 3. 

[0025] Drawing 4 shows the road configurations of the building of the current position, and a 
travelling direction as an information display based on the location input from the GPS antenna 
4. 

[0026] Display 22 which is different from drawing 4 in drawing 5 is shown (it corresponds to claim 
2). 

[0027] Although drawing 5 has shown the close-range view information which shows the current 
position, the intermediate view information which shows the information on over there for a 
while, and the distant view information which shows the information on distant further as 
information displayed on a high order plane 32, any 1 of three information or two can also be 
chosen. In addition, even if it is the usual display 1 A which is not equipped with a high order and 
the low order planes 32 and 31, the other data can be indicated by superposition with graphic 
display. 

[0028] Drawing 6 is a flow chart of processing used with drawing 4 and the operation gestalt of 
drawing 5 . In addition, - (SI) (S8) shows each processing. 

[0029] The image input from a television camera 2 is performed by processing (S1), and this is 
displayed on the low order plane 31 by processing (S2) as it is. 

[0030] On the other hand, in processing (S3), data reception is performed to an image input and 
coincidence from the GPS antenna 4, and processing (S4) performs location calculation. Here, 
the positional information of LAT LONG can be acquired. In processing (S5), processing (S6) 
performs retrieval processing from a database based on this, the last positional information, and 
this positional information in response to directions information, such as a distant view display 
and a close-range view display. The information acquired as a result of retrieval is processing 
(S7), determines an arrangement location and displays it on the high order plane 32 by 
processing (S8). 

[0031] By processing (S2) and processing (S8), it will be superimposed on each high order, the 
low order plane 32, and the thing displayed on 31, and a user will see to coincidence. 
[0032] Next, the detailed contents of processing of the processing in drawing 6 (S6) and 
processing (S7) are explained. 

[0033] Drawing 7 is a configuration of the target database in the case of the processing which 
searches related information by using location data as a key performed by the processing in 
drawing 6 (S6). 

[0034] The candidate for registration in a database can give the location data 1 (LAT 
information), the location data 2 (LONG information), the location data 3 (**, inside, ******), the 
target attribute (a traffic information, building information, etc.), and the information (text data, 
graphic data, etc.) to display, respectively, and is registered. 

[0035] The processing which is performed by processing (S6) of drawing 6 and which searches 
related information by using current position data as a key is explained using drawing 8 . 
[0036] The following definitions are made in drawing 8 . 

[0037] O It is the notation which shows the location based on the positional information acquired 
last time. In drawing 8 , it is displayed as P-1. Moreover, a position coordinate is expressed as 
(x~1, y-1). You may think as the LAT and LONG, respectively. 

[0038] O It is the notation which shows the current position based on the positional information 
acquired this time. In drawing 8 , it is displayed as Po. Moreover, a position coordinate is 
expressed as (xo, yo). 

[0039] - It is the notation which shows the location of the registered object, and more than one 
exist. Here, it is shown in drawing 8 by setting one of them to Pi, and the position coordinate is 
expressed as (xi, yi). 

[0040] From the above-mentioned information, the travelling direction vector Vd is computed 
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first When it considers as Vd= (xd, yd), they are xd=xo~x -1 and yd=yo-y -1. 

[0041] Here, the following processings are performed about each candidate for registration in a 

database. In the following explanation, description is advanced as performing processing to the i- 

th candidate for registration. In order to process all the candidates for registration, i should just 

process by increasing from 1 and attaching by the last candidate I for registration. 

[0042] 1) Compute the vector Vi between the current position Po and the object existence 

location Pi first. 

[0043] 

[Equation 1] 

Vi = (xdi,ydi) 

It is [0044] when it carries out. 

[Equation 2] 

xdi = xi - xo, ydi = yi — yo 

It comes out. 

[0045] 2) Next, compute the include angle theta which Vd and Vi accomplish. 

[0046] 

[Equation 3] 

oos 0 = (Vd • Vi)/(| Vd | • | Vi I) 

However, [0047] 
[Equation 4] 

( Vd • Vi) = xd* xdi + yd* ydi 

| Vd|=,/xd 2 + yd 2 

| Vi | =>/(xdi*xdi + ydi*ydi) 

It comes out. 

[0048] 3) Here, the angle of visibility defined beforehand is set to alpha, and if larger than the 
value of this one half, the following processings will not be performed as an object which does 
not go into a visual field. 

[0049] That is, the following processings are skipped if it is theta>alpha/2. 
[0050] 4) Next, find the target distance Li. 
[0051] 
[Equation 5] 

Li = | Vi | = V(xdi*xdi + ydi*ydi) 

5) If Li is larger than the numeric value given with the carbon button of the range directed now, 
for example, the distant view in drawing 5 , and a close-range view etc., the following processings 
will not be performed as outside for retrieval. 

[0052] That is, the following processings are skipped if it is LI, then Li>LI about the numeric 
value given by actuation of a user. 

[0053] 6) Pass the information in a database to the following display processing as what displays 
the candidate for registration which remained by the processing so far. 
[0054] The decision approach of the location when displaying on a screen the information 
acquired after retrieval performed by processing (S7) of drawing 6 is explained using drawing 9 . 
[0055] The following definitions are made in drawing 9 . 

[0056] H is the die length of the lengthwise direction of the window in the screen which displays 
a retrieval result, or a screen, i.e., height. 

[0057] Similarly L is the die length of the display screen of a retrieval result, or the longitudinal 
direction of a window, i.e., width of face. 

[0058] Pi is the distance from the center line of the width of face of the display screen or the 
window of the display position of the display information for [ which was obtained as a retrieval 
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result ] registration to right-harid side. 

[0059] Similarly h'i is the distance from under the display screen or the window of a display 

position. Display-position I'i and h'i are determined in the following procedure. 

[0060] 1) Define a horizontal location from the physical relationship of the between for [ by 

which the retrieval extract was carried out with the current position ] registration. Namely, 

[0061] 

[Equation 6] 

L/2 : sm(ir/2) = l'i : sin 8 

Therefore, [0062] 

[Equation 7] 

l'i = (1/2) sinfl 

2) Determine a vertical location, using the following relation f (x) as an example. 
[0063] 

[Equation 8] 

f (x) = (7r/2)arctan(x) 

Namely, [0064] 
[Equation 9] 
h f i = H*f (Li) 

Of course, it cannot be overemphasized that the decision approach of a location may use 

technique other than this. 

[0065] 

[Effect of the Invention] Since a television camera and location data acquisition equipment are 
connected to a migration terminal unit, the image inputted from the television camera 
superimposes the information related to this, this invention displays it on a screen, as explained 
above and retrieval processing can be performed based on the information on a retrieval 
location, more suitable information retrieval for a user can be performed. At this time, a user has 
the advantage that he does not need to be conscious about a location, at the time of retrieval. 
[0066] Moreover, since close-range view information, intermediate view information, and distant 
view information can be chosen and displayed on a screen, incorporation of positional information 
becomes easy. 
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* NOTICES * 

JPO and NCIPI are not responsible for any 
damages caused by the use of this translation. 

1 This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2.**** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

[Drawing 1] It is drawing showing the configuration of 1 operation gestalt of the terminal unit 
concerning this invention. 

[Drawing 2] It is drawing showing the processing flow after [ various / in drawing 1 ] an entry of 
data. 

[Drawing 3] It is a showing [ the configuration of the display of drawing 1 ] explanatory view. 
[Drawing 4] It is drawing having shown the display-function outline of the display of drawing 1 . 
[Drawing 5] It is drawing having shown other display-function outlines of the display of drawing 
1. 

[Drawing 6] It is a flow Fig. for explaining the flow of the processing in drawing 4 and the 
operation gestalt of drawing 5 . 

[Drawing 7] It is drawing for explaining the storing configuration of the database with which 
related information is searched by using location data as a key. 

[Drawing 8] It is drawing for explaining the processing which extracts registration information out 
of a database by using the current position as a key. 

[Drawing 9] It is drawing for explaining the display position when displaying on a screen the 
information acquired after retrieval processing. 
[Description of Notations] 

1 Pocket Mold Personal Computer 
1A Display 

2 Television Camera for Image Input 

3 Transmitter-receiver for Communication Link 

4 GPS Antenna for Location Data Acquisition 

1 1 Received Data 

12 DB Retrieval and Transform Processing 

13 Retrieval Output and Indicative Data 

1 4 Image Data 

15 Image Processing and Recognition Processing 

16 Recognition Data 

17 DB Retrieval Processing 

18 Retrieval Output 

19 Location Data 

20 DB Retrieval Processing 

21 Geographic Information and Related Information 

22 Display 

23 Transmission 

31 Low Order Plane 

32 High Order Plane 
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DRAWINGS 



[Drawing 1] 
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